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Abstract 

We show that the set of fixed points of the average of two resolvents can be found from the set 
of fixed points for compositions of two resolvents associated with scaled monotone operators. 
Recently, the proximal average has attracted considerable attention in convex analysis. Our 
results imply that the minimizers of proximal-average functions can be found from the set of 
fixed points for compositions of two proximal mappings associated with scaled convex functions. 
When both convex functions in the proximal average are indicator functions of convex sets, least 
squares solutions can be completely recovered from the limiting cycles given by compositions of 
two projection mappings. This provides a partial answer to a question posed by C. Byrne. A 
novelty of our approach is to use the notion of resolvent average and proximal average. 
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1 Introduction 



Throughout, "H is a Hilbert space with inner product (•,•) and induced norm || • ||, and T{T-L) is 
the set of proper lower semicontinuous convex functions on H. Let A : T-L ^ 2^ he a set- valued 
operator with graph gr A := |(x,u) G x 7^ | u G Ax}. The set-valued inverse A^^ of A has graph 
{{u, x) £ Ti \ u £ Ax}, and the resolvent of A is Ja ■= {A + Id)~^ where Id : % ^ % denotes the 
identity mapping. The operator A is monotone \i {x — y ,u — v) > for all {x,u), {y,v) £ gr A; A 
is maximal monotone if A is monotone and no proper enlargement of gr A is monotone. 

Let A\,A2 be two maximal monotone operators, and Ai -|- A2 = 1 with Aj > 0. The resolvent 
average of Ai, A2 with weights Ai, A2 is defined by 

A := [Ai Ja, + AsJ^a]"^ - Id, 

and it owes its name to the identity 

Ja = Ai J^j + A2 J42- 

This paper is concerned with the relationships among the fixed point sets of the resolvent average 
Ja, the resolvent compositions J a^IM'^ A^jXi '^''^d Ja2/\iJai/\2- -Although there appears to he no clear 
relationships between the fixed point sets o/Fix(Ai J^, -|- A2 J42); <^f^d of Fix Jaj^Ja2 and Fix -^Ai ; 
we will observe that Fix(AiJAi + -^2^42) can be completely recovered from Fix(J4,/;^2'^A2/Ai) or 

Fix(Jyl2/Ai^Ai/A2)- 

Our investigation relies on the resolvent average and proximal average, [8| \9\ \TT\ llOj. Although 
compositions of resolvents (even more generally strongly nonexpansive mappings) have been studied 
[3 ESI Ell El [IS El m [IB] , the connections between the fixed point set of compositions and the fixed 
point set of the average of two resolvents appear to be new, even when specialized to projection 
operators. 

The paper is organized as follows. Section [2] gathers some known facts used in later sections. In 
Section [3] we concentrate on resolvents. In order to find zeros of the resolvent average, we consider 
several inclusion problems. It turns out that their solution sets can be characterized in terms of 
fixed point sets associated with the resolvent average and with resolvent compositions. We provide 
homeomorphisms among these fixed point sets. In Section |4| we apply — and refine — the results 
of Section [3] to proximal mappings. The inclusion problems now translate into finding minimizers 
of proximal averages of convex functions. The Yosida regularization is the key tool for monotone 
operators, and its role is played by the Moreau envelope for convex functions. When specialized 
to projections, our results say that the least square solutions can be completed recovered from the 
solutions of alternating projections. This answers one of the question posed in [131 page 305] by 
Byrne for two sets, while the question for more than two sets is still open. In Section [5] we give 
three examples to illustrate our results. They illustrate that a recovery of Fix(Ai -|- X2JA2) from 
Fix(j4, J42) a-i^d Fix(j42 J^j) seems impossible. 

Our notation is standard and follows, e.g., [22 1 124 1 [25], For a monotone operator A :'H ^ 2^, the 
sets douiA := {x £ T-L \ Ax ^ 0},ranA := {u £ Ti \ {3x £ H) u £ Ax} are the domain, range of 
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A respectively. It will be convenient to write A := (— Id) o A ^ o (— Id). The Yosida approximation 
of A of index 7 € (0, +00) is given by 

(1) ^A:={ld-J.,A)h = hld+A-Y\ 

For a mapping T : D ^ T-L, where D <^ Ti, the fixed point set of T will be denoted by FixT := 
{x G I Tx = x}. A mapping T between metric spaces X and Y is called a homeomorphism if 
T is a bijection (i.e., one-to-one and onto), T is continuous and its inverse is also continuous. 
For a sequence (^Xn)n(^N of T~l, Xn — ^ x G H means that (^Xn)n£N converges weakly to x. 

For a proper lower semicontinuous function / G r('H), the sub differential operator df : H ^ H 
of / which is given by x 1— > df{x) := |x* G T-L \ f{y) > f{x) + {x*,y — x) Vy G is maximal 
monotone. The resolvent of df is called the proximal mapping of /, i.e., Proxj := Jgf. Note that 
Proxj has a full domain. Also, /* denotes the Fenchel conjugate of /, i.e., (Vx* G Ti) f*{x*) := 
supj, ((x*,x) — /(x)). The Moreau envelope of / with parameter 7 is given by 

e^/(x) := inf ( f(y) H Ik — y|P ) for every x 

y \ 2-f J 

The domain of / will be denoted by dom/. For /i,/2 G r('H), /i ® /2 means (/i © f2){x,y) ■= 
/i(x) + /2(y) for all x,y & 7i. We let j^^^) := ||2;|p/2 for every x G and we will use j and || • |p/2 
interchangeably. For a subset C C Ti, the indicator function is defined by tc(x) = if x G C and 
+00 otherwise. We use dc{x) := inf{||x — y\\\ y £ C} for every x G 7^ for the distance function, 
Pc '.= ProXip for the projection on set C, Nq '■= die for the normal cone operator, and int C for 
the interior of the set C. 



2 Auxiliary results and facts 



We gather some facts on strongly nonexpansive mapping, on the proximal point algorithm, and on 
fixed point sets of compositions of two resolvents. 

Definition 2.1 LetT : D ^U, where D CH. We say that 



(i) T is nonexpansive if 

\\Tx — Ty\\ < \\x — y\\ Vx, y £ D; 

(ii) T is strongly nonexpansive ifT is nonexpansive and (x^ — y„) — (Tx„ — Ty„) — )• whenever 
{xn)neN, iyn)n€N are Sequences in D such that (xn — yn) n€N is bounded and \\xn yn\\ W^^n 
TyJ^ 0; 

(iii) T is firmly nonexpansive if 

\\Tx — Tylp < (Tx — Ty, x — y) Vx, y £ D; 
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(iv) T is attracting if T is nonexpansive and for every x Fix T,y £ Fix T one has 

\\Tx - Ty\\ < \\x - y\\. 

The following fact is well-known. 

Fact 2.2 Let B :'H ^ 2^ be monotone operator and 7 > 0. Then 

(i) B-\0) = FixiJ^B) = rB)-\0). 

(ii) Jb is firmly nonexpansive. 

(iii) Jb has a full domain if and only if B is maximal monotone. 

Proof, (i). This may be readily verified using definitions involved, (ii) and (iii): See [19j or [21 Fact 
6.2, Corollary 6.3]. ■ 

Fact 2.3 (Bruck & Reich [12]) Let T, and (Tj) 

i<i<m be operators from H to H. Then the 

following properties hold: 

(i) // T is firmly nonexpansive, then it is strongly nonexpansive. 

(ii) If the operators (rj)i<j<m are strongly nonexpansive, then the composition Ti • • • T^, is also 
strongly nonexpansive. 

(iii) IfTi is strongly nonexpansive and T2 is nonexpansive and < c < 1, then S = {1 — c)Ti + CT2 
is strongly nonexpansive. 

(iv) Suppose that T is strongly nonexpansive and let xq £ Ti. //FixT 7^ 0, then the sequence 
(T"xo)n converges weakly to some point in FixT; otherwise, ||T"xo|| — ?• 00. 

Fact I2.2l fii) and Fact [2]3] immediately give the following result. 

Corollary 2.4 Let Ai, A2 : % ^ % he maximal monotone operators. For xq £ Ti let (x„)„gN be 
generated by 

(Vn G N) Xn+l = JAiJAiXn, 

For yo £ v. let {yn)n£N be generated by 

(Vn e N) yn+i = JAiJAiVn- 
If Fix JaiJa2 ^! then (xn) converges weakly to some point 0/ Fix J^^J^j, and {yn) converges 
weakly to some point 0/ Fix Jyij J^^ . 
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Fact 2.5 (Rockafellar |23| ) Let A : Ti ^ H be maximal monotone. Assume that A ^(0) / 0. 
For any starting point xq, the sequence (xn) generated by the proximal point algorithm 

Xn+l = JAiXn) = (Id+^)~^(Xn) 

converges weakly to a point in A~^(0) and x^+i — — > 0. 

Let R denote the "transpose" mapping on H xTi, namely R : H x Ti ^ Ti x Ti : {x,y) ^ {y, x). 
Fact 2.6 (See [?]•) Let A, B : Ti ^ Ti be maximal monotone operators and 7 G (0, +00). Set 

S := {ld-R + -/{A X B))-^{0,0). 
S* := m-Ry' + (A-i X B-') o (Id/7)]-'(0,0). 

E := {A+^By\0), F := {B + ^Ay\0). 
u* ■■= J(^-i+5)/^(0) and v* := J^x+B-^)/y(^)- 

Then Sj^04^S*j^0<^E^0<^F^0<^u* is well defined <^ v* is well defined, in which 
case the following hold. 

(i) E = Fi-kJ^aJ-jB = J-yAiF) and F = Fix J^bJ^ A = J-ysiE). 

(ii) S = Fix J^(AxB)^ = X F) n grJ^B- 

(iii) S* = {{ju* ,'yv*)} and u* = —v*. 

(iv) S* = {R-Id){S). 

(v) J-ybIe : E ^ F : X ^ X -\- ju* is a bisection with inverse J-fA\F '. F ^ E : y ^ y + 'jv* . 

(vi) E = A~^{u*) n yBy^iv*) and F = (^A)-i(n*) n B~^{v*). 

(vii) S={ExF)n{R- Id)-i(5*). 

Fact 2.7 (See, e.g., [5l Propositions 2.10, 2.12].) Assume that Ti,T2 are attracting and FixTi n 
FixT2 7^ 0. Let Ai + A2 = 1, with each Aj > 0. Then 

Fix(Airi + X2T2) = FixTi n Fixr2 = Fix(ri o T2) = Fix(r2 o Ti). 

The class of attractive mappings properly contains the class of strongly nonexpansive mappings. 
See also \12\ Lemma 2.1] for results related to Fact 12.71 

The following two facts relate the solutions of primal problems to the solutions of certain dual 
problems. For functions, a constraint qualification is needed; however, for monotone operators, the 
ensuing duality requires no constraint qualification. 
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Fact 2.8 (Fenchel-Rockafellar duality [241, [26]) Assume that f,g e r(^) and L : % ^ % is a 

continuous linear operator. Suppose there exists xq G dom /n L~^(dom (7) such that g is continuous 
at Lxq. Then 

inf {fix) + g{Lx)) = - min (/*(-L*y*) + g*{y*)) • 

Furthermore, x is a minimizer for f + g o L if and only if there exists y* ^T-L such that 

-L*r G dfix), y* G dg{Lx). 

Fact 2.9 (Attouch-Thera duality jjlj) LetA,B : T-L ^ 2^ be maximal monotone operators. Let 
S be the solution set of the primal problem 

find X £ v. such that G Ax + Bx. 

Let S* be the solution set of the dual problem 

(2) find X* £n such that G A-'^x* + B{x*). 
Then 

(i) S = {x en\ {3 X* £ S*) X* G Ax and - x* G Bx}. 

(ii) S* = {x* £n\ {3 X € S) X € A'^^x* and - x G B{x*)}. 

Moreover, let S* be the solution to the dual problem given by 

(3) find y* en such that G A{y*) + B-^{y*). 

Then = —S*. Consequently, up to a '— ' sign change in the dual variable, the Attouch-Thera 
duals ([2]) and ^ have the same solutions. 

The last result recorded in this section concerns basic properties of the resolvent average. 

Fact 2.10 (resolvent average) Let A\,A2 : n. ^ 2^ be maximal monotone operators, let 
^1-, -^2,7 > with Ai + A2 = 1, and set 

_ (Al J-yAi + X2J'yA2)~^ - Id 

7 

Then 

(i) JjA = ^iJ-yAi + 0,1^^ '^A = Xi'^Ai + A2'^^2- 

(ii) A is maximal monotone. 

Proof, (i) follows from the definitions involved, (ii): By Fact I2.2f iii) and maximal monotonicity of 
J'yAi is firmly nonexpansive and has a full domain so that J^a is firmly nonexpansive and has 
a full domain. Then by Fact I2.2( iii) again -jA is maximal monotone, so is A. ■ 
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3 Fixed points of resolvent average and compositions 



In this Section, we assume that Ai,A2 : H ^ 2^ are maximal monotone operators, and that 
Ai + A2 = 1 where each Aj > 0. 



3.1 Inclusion problem formulations and their common Attouch-Thera dual 

Consider the inclusion problems 

(4) (R-y) find z such that € ({^iJ'yAi + ^2J'yA2) ^ ~ W )(z); 



(5) (P^) find z such that = (Ai + A2 ^^2) (2); 

7 V A2 Ai 

find X such that G i— — h y~j J 



(6) (P) find (x, y) such that (0, 0) G f + (4^ x ^ ) ] (x, v)] 



^^Ai\ A2 



(7) 

(8) find y such that G (^y^j + (y). 

Theorem 3.1 Problems dH)-® are equivalent in the sense that if one of the problems possesses 
a solution, then so do all the others. 

Proof. (HI) 4^ ([5]): z solves ^ if and only if z solves G A{z) where 

^ _ (AiJ-yAi + A2 J-yAa) ^ - Id 
7 

It suffices to apply Fact E^li) and Fact \TM i) to A. 

(jljl^jS]): Note that z solves ([4]) if and only if 2; = XiJ^Aiiz) + X2J'yA2{z)- Let J^Ai{z) = x, 
JjA2{z) = y- We have z solves (H]) if and only if 

{z = Xix + A2?/ 
y = J^Aiiz)- 

We claim that (x, y) solves ([6]). Indeed, ([9]) gives z G 7^1 (x) + x, z G 7^2(2/) + ?/; i-e-, 

(10) G 7^i(x) + (x - z) 

(11) G 7^2(2/) + {y- z). 
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As z = Xix + A2y, we have x — z = X2{x — y), y — z = \i{y — x). Therefore, (fTOj) gives 

(12) 0G7Ai(x) + A2(x-y) 

(13) G 7^2(2/) + Ai(y-2;), 

equivalently, 

(14) oe^^ + (x-y) 

A2 

(15) Oe4M + (,_,). 
In the product space setting, 

(16) (0,0)ef(ld-i?)(x,,) + ^x^^^(^^ 



A2 Ai 



Dividing both sides by 7 gives 



, . /(Id-i?), . ^1(2;) ^2(y) 

17 0, G ^ ^ X, y + X 

V 7 A2 Ai 

as required. Conversely, let (x,y) solves Put z = Aix + A2y. Exactly reverse the arguments 
from ([HD to ^ to get Q. Hence z solves (g]). 

(I6])<(^(17]): {x,y) solves ([SD if and only if 

(18) 0€^^ + (x-y) 

A2 

(19) oe4M + (,_,). 

From ([H]), y = J^Ai/Xiix)- Put this in 1^ to get 

(20) OG^^^ + x- J^A,/,,(x). 
Dividing both sides by 7 gives 

G ^i(^) + ^-■^7A2/Ai(a^) ^ ^i(x) ^ ^/^\ 

A2 7 A2 V Ai / ' 



which says that x solves ([7]). Conversely, x solves ([7]) if and only if ([20]) holds. Put y = J^j^^jx^^x). 
Then x € 7A2(y)/Ai + y, and ([20]) gives G ^^^4^ + a; - Hence {x,y) satisfies ([IHD and (fT9]l . 

As in ([6])44>(I7]), similarly one can show (I6])<;4>(l8]). ■ 

We proceed to show that all of them share one common Attouch-Thera dual problem. 
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Theorem 3.2 Up to a '— ' sign change of variable, the following inclusion problems have the same 
Attouch-Thera dual solution. 



{i) (P-y) find z such that £ + (z); 



7 + Ua ^ Ai 



)) ix,y); 



A2 ^ ^ 

(ii) (P) find {x,y) such that (0,0) G 

(iii) find x such that G + '^(4f )) (x); 

(iv) find y such that G (^(^) + ) (y). 

Namely, up to a '— ' sign change in the dual variable, their Attouch-Thera dual has the form 

(21) find z* such that G 72* + (Ai/A2)~^(z*) + A^i{z*). 

Moreover, the set of solutions is either empty or a singleton. 



Proof. By ([U), we have 



(i). The Attouch-Thera dual is: 



'-'A = -{^A)-\-ld) = -fU+A, 
aJx = I(AId). 



G 



CAi/X2)-' + ^A2/Xi {z*). 



We have 



(^Ai/As)"' + ^'A2/\i = {^A^r\\2M) + X42(Ai Id) 

= (7ld+A^^)(A2ld) + (7ld+32)(AiId) 
= 7ld+Ar^(A2ld)+22(AiId) 
= 7ld + (^i/A2)"^ +^7^1. 



Hence the dual is 
(22) 



OG [7ld+(Ai/A2)-^+^2/Ai](z* 



(ii). The Attouch-Thera dual is 
(23) (0,0) G 



7(Id-i?)- + (^x^ 



(^*,y*). 
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Since ran(Id— i?) = {{d, —d) \ d G T-C\, we have y* = —x*. ([23|) reduces to find x* such that 



(0,0) G 



7(Id-/?)-+(^xi^ 



{x\-x*). 



Then x* solves the dual if and only if there exists y G Ti such that 



(o,o)G7(y + x*,y) + (^) \x*)x('^') \-x* 



which transpires to 



This is equivalent to find x* such that 



E 7X* + I — I ix' 



A2 



{-x*)= 7ld+(Ai/A2)"^+A2/Ai (x*). 



(iii). The Attouch-Thera dual is 



The right-hand side becomes 



A 



Hence the dual is 



7ld+(Ai/A2)-^+yl2/Ai (x*). 



^ j + 7 Id + iy^j = 7 Id +(Ai/A2)-^ + A2/X1 



G 



(iv). The Attouch-Thera dual is 



We have 

Then the dual becomes 
that is, 



0€"'{A,/X2)iy*) + iA2/Xi)-\y*). 

^(Z7a2) + (^2/Ai)-i = 7ld+^/A2 + (^2/Ai)-i. 
G 7/ + ^/A2(y*) + (^2/Ai)"^(y*), 



G 72/* - (^i/A2)-H-y*) + (^2/Ai)-i(y*). 
Multiplying both sides by —1, followed by making the substitution z* = —y*, we obtain 

G 7^* + (^i/A2)-^(^*) + A^iiz*). 

The proof is complete. ■ 
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3.2 Characterization of solution sets 

Problem ^ has its Attouch-Thera dual given by 

(24) (D) find {x*,y*) such that (0,0) € (^^^) ^ {y ^ y) )^^*'^*)- 

The following result gives a fixed point characterization to the solution sets of (jH)-® when 7 = 1. 

Theorem 3.3 The following assertions hold. 

(i) (Fixed points of resolvent average) Let A = {XiJai + A2Ja2)~^ ~ M. Then 

Fix Ja = (AiUi + A2%)"'(0) = {ze'H\z = JAiz) = XiJaA^) + A2Ja2(^)}. 

(u) (Fixed points of compositions) Set E := + ^(jf)) V)- '^^^^ ^ = 

Fix JAi/Aa-^Aa/Ai = -^Ai/A2(-^)- 

(iii) (Fixed points of compositions) Set F := (^(^) + ^) \o). T/zen F = 
Fix Ja2/Ai«^Ai/A2 = •^A2/Ai(-E')- 

(iv) (Fixed points of alternating resolvents) Set S := (^(U-R) + x 4f )) ^ (0,0). Then 

S = {{x,y)\x = J^^/^^y,y = Ja^/x^x} = Fix (JA1/A2XA2/A1 o R) = {E x F) Hgr J^^/Ai- 

(v) Set S* = (^{U-R)-^ + ^ 4f)"^) ^ (O'O)- ^^^^ ^* «^ "^o-^^ « singleton with 

Moreover, u* = —v*. (Note that S* may be empty, which is equivalent to the impossibility to 
compute the resolvents defining u* and v* .) 

(vi) S* = {R — Id)(5). Consequently, for every {x,y) £ S, y — x = u* , i.e., the gap vector is 
unique. 

(vii) E = {Ai/\2rHu*) n ('(^2/Ai))~' (v*) and F = ('(^i/As))"' {u*) n {A2/ XiyHv*)- 

(viii) Ja2/AiIs : E ^ F : X ^ X + u* is a bisection with inverse mapping Jai/x-z ■ F ^ E : y ^ 
y + V*. 

(ix) 

(25) S = {E X F)n{R-ld)-\u*,v*) 

(26) =(^^x^) \u*,v*)n{R-Ur\u*,v*). 
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(xi) The sets Fix(JA), E, F, S are closed and convex. 

Proof, (i). z E (Ai + A2 %)"^ (0) if and only if 

0= (AiUi + A2%)(z) = Ai(Id-JAj(z) + A2(Id-JA2)(2) 

= z - (Ai + A2 Ja2)(2;) = z - Ja{z). 

(ii)- equation (|25p of (ix) follow by applying Fact 12.61 with A = A1/A2, B = yl2/Ai and 7 = 1. 
To show (I26p . we assuem that S and 5* are nonempty. Note that 

S=[{x,y): (0,0) G ( {U-R) + x {x,y) 



A2 A 



and that 

S 



so we can use Fact I2.9( i) to get 

S = {{x,y) : {3{u*y) G S*) {u\v*) G x (x, y), -(n*, t;*) G {ld-R){x,y)}. 



By (v), 5* is singleton so that S* = {{u*,v*)}. Hence ^ holds. 



(x). By (i) , 2; G Fix <^ G -^-^ + -^-^ {z). The latter has its Attouch-Thera dual given by 



equivalently by (f22]l (with 7 = 1) 

OG [Id+(^i/A2)-^+i/A'i](z*), 
and it has a unique solution u* by (v). Fact I2.9n ) gives that z G Fix J^i if and only if 

-(^)"<-'n(^)''(-). 

(xi). It is well-known that if S : ?^ ^ 2^ is maximal monotone, then B{x) is closed and convex 

for every xeTi. Observe that Ai Ui + A2 ^ + ^jf) ' ^(ij) + 4f ' and (Id -R) + x ) 
are maximal monotone operators by Rockafellar's sum theorem, see [251 pages 104-105] or |21j . 
Then (A,% + A2%)-\ + {{Id - R) + {^x .re ma^m.l 



monotone. Hence the result holds by the definitions of these sets given in (i) (iv 
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3.3 Relationship among solution sets 

Recall that 

(27) J A = ^iJai + ^2Ja2 with Ai + A2 = 1 and Aj > 0. 

We now study the relationships among Fix J a-, E = Fix( J^^/;^2'^A2/Ai )) F = Fix( J42/A1 Jai/m)-! ^^^d 

S = {{x,y) I X = JAjX2y^y = Ja2/Xix]. 
Lemma 3.4 {\) If x = Ja^/x^V, y = Ja^/x^x, then 

Aix + A2y G Fix J^, j; E Fix J^^/^^ J^a/Ai, 2/ G Fix J^^/^^ J^i/Aa- 

(ii) Ifx = Ja^/x2Ja2/XiX, put y = Ja2/XiX, then \ix + A2y G Fix J^i. 

(iii) Ify = JA2/x^JA^/X2y^ Put x = J^i/Aay^ ^^en Aix + A2y G Fix J^i. 

Proof, (i). We have 

x^JA^/X2y ^ ye—x + x, 

^2 
^2 

yeJA2/XiX <^ 2;G-— y + y, 

so that — A2X + A2y G Aix and Aix — Aiy G ^2y- Then Aix + A22/ G ^ix + x, Aix + A2y G A2y + y, 
equivalently x = Ja^ (Aix + A2y), y = Ja2 (Aix + A2y). This gives 

Aix + A2y = Ai J^,(Aix + A2y) + A2Ja2(Aix + A2y) = [Ai J^i + A2Ja2](Aix + A2y). 

Hence Aix + A2?/ G Fix J^i. 



(ii) and (iii): In either (ii) or (iii), we have x = JAxjX2y^ 2/ — Ja2/XiX- Hence (i) applies. 



Lemma 3.5 If x ^ Fix Jyi, then 

(28) X = Ja^/X2 {Ja2 x) , 

(29) JA2X = Ja2/Xi{Jaix). 
Consequently, Ja^x G Fix J^^/^a Jas/Ai and J^jX G Fix J^j/Aj J^i/Aa- 

Proof. Let us show (j28l) . By assumption, x = Ai Jai^; + A2 Ja2^) we write 

T x-AiJajX 

(30) JajX = . 

A2 



13 



We have 

JajX = JaxX <^ X e {Ai + Id)(JAix) = Ai{Jaix) + Ja^x 

4^ X £ Ai^Ja^x) + XiJa^x + X2JA1X (since Ai + A2 = 1) 

<^ X - XiJaiX e j4i(Jyi^x) + X2JA1X = {Ai + A2ld)(Jyiix) 

X — XiJatX , T i \ / T \ 

^ ^ ^ G (Ai/A2 + Id)(JAi2;) 

^ Ja^xG (^i/A2 + Id)(JA,x) (by dan])) 
JajX = J4^/A2(Ja22;). 

The proof of ()29p is similar. ■ 

Note that 

S" = {(x,y) I X = JArlMV^V = ^Ailx^A- 



Theorem 3.6 Define 

T : S —?■ Fix Ja ■ {x, y) ^ Xix + A22/. 
Then T is a homeomorphism, and the inverse of T is given by 

: Fix — 5 : z I— {JaiZ, Ja2z)- 
Consequently, Fix = L{S) where L : % x % ^ % : {x,y) ^ Xix + X2y- 

Proof. For every (x,y) G 5, by Lemma [3.4( i). T{x,y) G FixJ^, so T(5) C FixJ^- For every 
z G Fix J^, by Lemma [331 (-^Ai-Z, JA2Z) G and z = AiJai(^) + ^2Ja2{z) = T{Ja^z, Ja2z), thus 
T{S) D Fix J^. Hence T{S) = Fix J^, i.e., T is onto. To show that T is one-to-one, let {xi,yi) G S 
for i G {1, 2}. If T{xi,yi) = r(x2, 2/2), i-e., AiXi + X^yi = X1X2 + A2y2, then 

Ai(xi - yi) +yi = Xi{x2 - 1/2) + y2- 



By Theorem I3.2|(v)| and (vi) S* is unique and xi — yi = X2 — y2 = v* , thus yi = y2 and xi = X2- 



Since for z G FixJ^, ( Jyi^ (z), (z)) G S and z = T(Jaj (z), (z)), T is one-to-one and 
onto, we obtain that T~^{z) = (Jai{z),Ja2{z))- In addition, both T,T~^ are continuous. Hence 
T : S" — 7- Fix Ja is a homeomorphism. ■ 

Theorem 3.7 (i) The mapping 

Ti : E ^ S : X ^ {x, Jaj/Ai^;), 
is a homeomorphism and its inverse is given by 

T^^ : S ^ E : {x, y) ^ x. 
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(ii) The mapping 

T2: F ^ S -.y^ (JAi/XiV^y), 
is a homeomorphism and its inverse is given by 

T^' :S^F:{x,y)^y. 



Proof. We only prove (i) , since (ii) can be proved similarly. To see (i) let x €z E. By the definition 



of E, X = Jai/\2Ja2/XiX- Put y = JAi/x^x. We have 

X = JAi/XiV^ y = JA2/X1X, 
whence Tix = {x,y) G S. Therefore, Ti{E) C 5. Now for every {x,y) G S, by the definition of S, 

X = JAi/XiV^ y = JA2/X1X, 

then X £ E and {x,y) = (x, J^j/Ai^) = Tix. Therefore, S C Ti{E). Hence Ti{E) = S. Clearly, Ti 
is one-to-one. Altogether, Ti is one-to-one and onto. Since for every (x, y) G S, 



= {x.Ja^/x^x) = Tix, 



we have ^{x,y) = x. 



The next result provides a partial answer to a question raised by C. Byrne (see [1'6\ page 305]). 
It provides the transformations to go back and forth between fixed point sets of compositions of 
resolvents and the fixed point set of the average. 

Theorem 3.8 Let u* be given as in Theorem \3.3\f v). 

(i) The mapping 

Hi : E ^ Fix Ja : x 1-^ Aix + X2JA2/X1X = x + X2U*, 
is a homeomorphism. Moreover, H^^ : Fix E is given by H^^{z) = Jai{z). Hence 

(31) Fix Ja = E + X2U* . 

(ii) The mapping 

H2 : F ^ Fix Ja : y ^ Ai J^j/Ajy + A2?/ = -Aiu* + y, 
is a homeomorphism. Moreover, H2^ ■ Fix J^i F is given by H2^{z) = Ja2{z). Hence 

(32) Fix Ja = F - Xiu*. 

Proof. Combine Theorem 13.61 and Theorem 13.71 Using the same notations as in Theorem 13.61 and 



Theorem 13. 7| (i) follows from Hi = T oTi; (ii) follows from H2 = T 0T2. Moreover, 

{y X e E) Hi{x) = Xix + X2JA2/X1X = X + X2{Ja2/XiX - x) = X + X2U*, 

{y y € F) H2{y) = XiJA^/x^y + X2y = Xi{JA^/x2y -y) + y = Xi{-u*) + y, 
by Theorem 13. ^fvi) Hence (i3T]l and ([32]) hold. ■ 



15 



Corollary 3.9 The following is true. 

(i) E ^ ^ F ^ ^ S ^ ^ S* ^ ^Fix Ja^ 0. 

(ii) E is a singleton F is a singleton S is a singleton 4^ Fix Ja is a singleton. 

(iii) Fix Ja = XiE + X2F. 

Proof, (i) and (ii) follow from Theorems 13.61 13-71 and Theorem I3.8[ It remains to prove (iii) . By 
Theorem [33 

Fix Ja = E + X2u\ Fix Ja = F - Xiu* . 



As Fix is convex by Theorem I3.t^(xi) we obtain 

Fix Ja = Ai Fix Ja + X2 Fix Ja = XiiE + X2U*) + A2(F - Am*) = Ai^ + A2F, 
as claimed. ■ 

3.4 The case when Fix ^ FixJa^/\-^ ^ 

Note that 

(33) Fix = Fix J^i/Aa > Fix Ja^ = Fix Ja^/Xi ■ 

Theorem 3.10 Assume that Fix Jaj^/x2 H Fix J^^/Ai 7^ ^- Let Ai + A2 = 1 with Xi > 0. Then 

Fix(AiJAi + A2Jyi2) = Fix nFixJ^a = Fix 74^/^2 nFix Ja^/x^ 
= Fix{JA^/x2 o Ja^/x^) = Fix{JA2/Xi o Jai/X2)- 

Proof. In view of ([33j) . Fix J^^j nFix Jyij 7^ 0. Since every resolvent is attracting, it suffices to apply 
Fact O ■ 



4 Minimizers of the proximal average 

We now specialize our results to Ai = dfi and A2 = df2 for two proper lower semicontinuous 
convex functions /i , /2 ■ This allows us to understand the results of Section [3] from the variational 
analysis perspective. Let /i, /2 £ r('H) and Ai + A2 = 1 with each Xi > 0. 
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4.1 Minimization problem formulations and their common Fenchel-Rockafellar 
dual 

We consider 

(34) mm g{x,y) := — \ h 



(x,y) \ X2 Al 2 

This turns out to be closely related to the proximal average of /i , /2 , recently studied in [51 |H1 HH [TO] • 
Recall 

(35) (yzGX) p^{f,\)iz)= inf (Ai/i(x) + As/sl?/) + - ), 

z=Xix+X2y ' 

where / = (/i, 72), A = (Ai, A2),7 > 0. When 7 = 1, we just write p{f, A). Therefore, (|34l) has the 
same minimum value as the scaled proximal average 

(3d) mm ■ 



A1A2 

In terms of Moreau envelopes, (j34|) can be reformulated as 

(37) min g,{x) := /i(x)/A2 + ei(/2/Ai)(x) 
and 

(38) min g2{y) := ei(/i/A2)(y) + /2(?/)/Ai. 

y 



With regard to ([36j) . we also consider 

(39) mm 53(2;) := Aiei/i(2;) + A2ei/2(z) = mm A1A2 — \ 

^ 2 V A2 Al 

The following facts about proximal average will be useful. 

Fact 4.1 (i) (See [H Theorem 4.10].) For every z £ domp^(/,A), there exist x e dom/i,y G 
dom/2 such that z = Xix + A2?/ and 

p,{f, A)(z) = Ai/i(x) + A2/2(y) + 

(ii) (See [HI Theorem 6.2].) e-yp^{f,\) = Xie^fi + X2e-yf2- 

(iii) (See [51 Theorem 6.7].) F}:oXp(^f x) = AiProxj^ +X2Pmxf^. 
Fact 4.2 Let f G TC^) and 7 E (0,+oo). T/ien 

(i) e^f is Frechet differentiable on % and ^{e^f) = ^{df) = (Id — Prox^j)/7. 
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(ii) mf(e^/) = inf / and argmm(e^/) = argmin/. 

Proof. See \16\ Lemma 2.5] and [20]. See also \24:\ Example 1.46 and Theorem 2.26]. ■ 
Proposition 4.3 For the minimization problems given by ()34p -( [39]) . we have 

■ I N . P{f,>')iz) ■ f ^ ■ f \ ■ g3(^) 
mmg[x, y) = mm — = mm gi{x) = m.m.g2yy) = mm - — — . 

{x,y) z A1A2 a; y 2 A1A2 

Proof. While the first three equalities are immediate, the fourth one follows from Fact 14.1( 11) and 
FactH^Tii). ■ 



The following result is a convex-function refinement of Theorem 13.21 It says that convex opti- 
mization problems (j34p . (I37p . (j38p . (I39p share one common Fenchel-Rockafellar dual problem. 



Theorem 4.4 Up to a sign change in the dual variable, the following problems have the same 
Fenchel dual. 



(i) 



(ii) 



m 



(iv) 



. ' hix) , f2{y) , \\x-y 

mm — ; 1 ; h 



\x,y) \ A2 Ai 2 

min /i(a;)/A2 + ei(/2/Ai)(a;). 



min ei(/i/A2)(?/) + /2(y)/Ai. 
y 



. ei/i(z) 61/2(2;) 
mm — ; h 



Ao A 



Namely, up to a '—' sign change in the dual variable, their Fenchel-Rockafellar dual is given by 

|2- 

(40) {D) max 



2 

Proof, (i). Using the Fenchel-Rockafellar Duality theorem (Fact [2^ for /1/A2 © f2/^i, 3 ° L with 
j = \\ - f/2 and L = (Id, - Id) : ^ x ^ ^, we obtain the dual problem (Ii0]l . 

(ii). The Fenchel dual is given by 

sup-(/i/A2)*(-0)-[ei(/2/Ai)]*(0). 
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As [ei(/2/Ai)]* = (/2/A1)* + j, its Fenchel dual becomes 

sup-(/i/A2)*(-<A) - (/2/Ai)*(<A) - ||<AllV2. 



(iii) . The Fenchel dual is 

sup-[ei(/i/A2)]*(-<A)-(/2/Air(</<) 

= sup -(/i/A2)*(-c/.) - II - </>||V2 - (/2/Ai)*(<5 

= sup-(/i/A2)*(-(A) - (/2/Ai)*(<^) - II0IIV2. 

(iv) . Its Fenchel dual is 

(41) sup-f^VM)-f^V(0). 



Now 



A2 



= f (ei/i)*(A2-) = + j)(A2-) 

A2 / A2 A2 



^/r(A2-) + A2j= +A2j. 



Similarly, 



Then (1411) becomes 



A 



a7' +^^^- 



- ^^jM) - ) (</>)- Aii(0) 

The proof is complete. ■ 

When the primal problem (j34p has a finite infimum value, the primal optimal value and the dual 
optimal value are equal; moreover, the dual optimal value is attained. 

While the solution set of the primal problem (j34p (see Theorem l4.7r i)) may be empty, the solution 
set of the dual problem (|40p is nonempty and a singleton as long as (134p has a finite infimum value. 
This feature of Fenchel-Rockafellar duality is in stark contrast to the Attouch-Thera duality of 
Section [31 see Corollary 13. 9( i). 

Theorem 4.5 When the primal problem ()34p has a finite infimum, the dual (D) has a unique 
solution 

(42) = Prox(j^/A2).o(-id)+(/2/Ai)*(0). 
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(43) dom(/i/A2)* n -intdom(/2/A2)* / or hit dom(/i/A2)* n - dom(/2/A2)* / 0, 
then 



(44) 



Proof. From (j40p . we have 

G a[(/i/A2)* o (- Id) + (/2/A1)*] + 

so dMI) holds. 

Under the assumption (|43|) . we can apply the chain rule so that 

G _(a/i/A2)-^(-0) + {df2/\ir\4>) + ^ = dh/X2i^) + (9/2/Ai)"^(<^) + 4>- 
Hence the first equality in (|44p holds. Rewrite the dual problem (j40p as 
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and denote its optimal solution by ih. Then —ib = and tp = J,^ , , , ^-"^ (0). Therefore, the 

(0/1 /A2) ^+d/2/Ai 



second equality in (j44j) holds also. ■ 

Remark 4.6 Note that [71 Proposition 4.3] also implies ()42p as well as 

= -Prox[(^2/^^)n(/,/A2o(-id))]"(0)- 
Observe that cp = v* as given in Theorem I3.3f v). 



4.2 Characterization of minimizers 



Set 



S 
E 
F 



{{x,y)\x = Proxjj/A2 y, y = Pmxf^/x^ x}, 
Fix(Proxjj/A2 Proxj^/A,), 
Fix(Proxj2/A, Proxj^/Aj. 



Theorem 4.7 T/ie following assertions hold. 

(i) (Fixed points of alternating proximal mappings) 5 = argmin^r C E x F. 
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(ii) (Fixed points of proximal mapping composition) E = argmin gi . 

(iii) (Fixed points of proximal mapping composition) F = argmin (72- 

r 1 1 1"^ 

(iv) argminp(/, A) = argmin = Ai (dfi) + X2 (8/2) (0). 

(v) (Fixed points of the average of proximal mappings) 

(45) argmin p(/, A) = {A1X + A22/ \ {x,y) £ S} 

(46) = Fix(ProXp(-y^ _;^)) = Fix(Ai Proxj^ +A2 Pvoxj^ 

(vi) The sets 5, -E, F, Fix(Ai Proxj^ +A2Proxj2) are dosed and convex. 
Proof. We have 

^ , , fdfUx) df2(y) 
og[x, y)={ ^x-y, h y - X 

= (^x^ + (Id-i?))(x,,). 

Moreover, using Vei/j = ^{dfi), 

Vei(/i/A2) = '[5/1/A2] = Id-Prox^^/;,,, Vei(/2/Ai) = ^[9/2/Ai] = Id - Prox^,/;,, , 
by Fact 14.21 we obtain 

(47) dgi = 5/1/A2 + ^[9/2/Ai] = 5/1/A2 + Id - Proxj^/x,, 

(48) dg2 = 5/2/Ai + \dh/X2] = 9/2/Ai + Id - Proxf^/x,, 

(49) V<73 = Ai \dfi) + A2 \df2) = Id -(Ai Proxy, +A2 ProxfJ. 

Then (i)-(iii) fohows from Theorem 13.31 bv using Ai = dfi,A2 = 8/2, or [71 Proposition 4.1] by 



using 7 = 1 and functions /i/A2,/2/Ai. To show (iv) , apply Fact I4.1( ii) to obtain eip{f,X) = 
AiCi/i + \2^\H- Since argmin eip(/, A) = argminp(/, A) by Fact 14. 2^ we have the first equahty of 
(iv)| Furthermore, ([49]) gives argmin ^3 = Vgg ^(0) = [Ai \d!i) + \2\d h)\~^ {^) ■ 



(v): We first show (05]). Let z G argminp(/, A). By Fact I4.ir i). z = Aix + A2y for some (x^y) 
with 

p(/,A)(z) ^ /i(x) ^ hhi) ^ \\x-yf 
A1A2 A2 Ai 2 

By Proposition 14.31 '^^^■^x^^ = miny, so {x,y) G argminy. As S* = argminy by (i), we have z £ 
{Aix + A2y I {x, y) G 5}. Conversely, if {x, y) E S, then by definition oip{f, A) and Proposition 

p(/,A)(Aix + A2|/) ^ fi{x) f2{y) ^ \\x-yf . . p{f,X) 

- + + ^ =mmg = mm , 

A1A2 A2 Ai z A1A2 
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thus Xix + \2y G argminp(/, A). Therefore, (jl5]) holds. Note that (jl6|) folfows from Fact I4.1l fiii) 
and Fact EZl^i) for 7 = 1. 

(vi): Indeed, these sets are argmin sets of fower semicontinuous convex functions g, gi,g2,p{f, A) 
respectively. ■ 

Problem ()39p is a least squares problem in terms of convex functions /i, /2. The next result is 
well known. 

Corollary 4.8 (least square solution) Let /i,/2 G r('H) and Ai + A2 = 1 with each Aj > 0. 
Then 

(50) Fix(Ai Proxjj +A2Proxj2) = argmin(Aiei/i + A2ei/2). 
When fi = with Ci C % being nonempty closed convex, we have 

(51) Fix(AiPci + ^2Pc,) = argmin f Ai% + Aa^ 



2 ^ 2 

Proof. Combining Theorem |4?7 Tiv) and (v) gives (f50]l . Observe that Prox^^^, = Pc*. and eiic*. 



d^y2. Hence ([51]) follows from ([50]). ■ 

The following result says that when 5 7^ 0, for every (x, y) £ S the difference x — y, sometimes 
also called the gap vector, is the unique solution to the dual problem. Characterizations of 5, E, F, 
and Fix(Ai Prox/-^ +A2 Proxjj) in terms of dual solution (p come as follows. 

Theorem 4.9 (i) We have {x, y) £ S and (j) £ S* if and only if 

{-(j), (p) £ dfi{x)/\2 X df2{v)/\i, 4> = x-y. 

(ii) Let (j) be the unique solution to (D) and assume that S ^ 0. Then for every {x,y) £ S, one 
has X — y = (j). Moreover, 

s = (9/1/A2 X df2/Xi)'\-^, ^)niR- id)-\-^, 

Proof (i). Use L* = (Id, -lA) : U ^ U ^ U, f = /1/A2 /2/A1 and g = j. By Fact ESI again, 
{x,y) £ S and (j) £ S* ii and only if 

(-(/), 0) £ dfi{x)/\2 X 9/2(y)/Ai, (l) = x-y. 

(ii). As the dual objective function is strictly concave, the dual solution is unique, say (f). It suffices 
to apply (i). ■ 

Theorem 4.10 (i) x £ E if and only if 

-4> £ dfi{x)/X2, cf) = X -FToxf^/x^{x). 
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(ii) y £ F if and only if 

-4> = y -Fvo^f^/Xiiy)^ G 5/2(y)/Ai. 

(iii) z £ Fix(Ai Proxjj +A2 Proxj^) if and only if 

-4> = ^2 - Prox/,(2;)), (j) = X^^{z - Fmxf^iz)). 

Proof. This follows from Theorem 14.41 and Fact 



Remark 4.11 Theorems 14.91 and 14.101 are convex function analogues for Theorem I3.5|(vi) (vii 



(ix) and (x) 



4.3 Relationship among minimizers 

We now study the relationships among Fix(Ai Proxj^ +A2 Proxjj), E = Fix(Proxjj/;^2 Proxj^/Ai)) 
F = Fix(Proxj2/Ai Pioxf^/x^), and 

S = {{x,y) \ X = Proxj^/A2 y, y = Proxj^/Aj x}. 

Theorem 4.12 Let (p be the dual solution, i.e., the solution to ()40p . Define Ti : E ^ 
Fix(Ai Proxj^ +A2 Proxjj) hy 

Ti{x) = Xix + A2 Proxj2/Ai(2;) = X - \2(t>- 

Then Ti is a homeomorphism with T^^{z) = Proxj^(z). Consequently, 

(52) Fix(Ai Prox/^ +A2 Prox/J = E- \2^. 



Proof. Use Theorem with Ai = dfi foi i = 1,2. ■ 

Theorem 4.13 Let (p be the dual solution. Define T2 : — )• Fix(Ai Proxj^ +A2Proxj2) by 

T2{y) = AiProxj^/A2(?/) + A2y = y + \i(t>- 

Then T2 is a homeomorphism with T2^{z) = Proxj2(-z)- Consequently, 
(53) Fix(Ai Prox/^ +A2Prox/2) = F + Xi4>. 



Proof. Apply Theorem I3.^(ii)| with Ai = dfi for i = 1,2. ■ 
Theorem 4.14 Define T : S ^ Fix(Ai Prox/^ +A2 Prox/J by 

T{x,y) = Xix + A2y. 

Then T is a homeomorphism. Moreover, for every z G Fix(ProXp(j _\)) one has T^^(z) = 
(Proxj^(z),Proxj-2(-2))- Consequently, Fix(AiProxjj +A2Proxj2) = L{S) where L :% xH ^ H 
{x,y) i-> Xix + A2y. 
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Proof. Use Theorem 13.61 with Ai = dfi for i = 1,2. ■ 

Theorem 4.15 The mapping Proxjg/Ail-B : E ^ F is a homeomorphism with inverse Fioxf-^/x^lF- 



Proof. The results foUow from Theorem [3]3(viii 



Corollary 4.16 (i) E ^ if and only if F ^ if and only if S ^ if and only if 
argminp(/, A) = Fix(Ai Prox/-^ +A2 Proxjj) 7^ 0- 

(ii) E is a singleton if and only if F is a singleton if and only if S is a singleton if and only if 
argminp(/, A) = Fix(Ai Prox/-^ +A2Proxj2) is a singleton. 

(hi) Fix(Ai Prox/i +A2 Prox/J = XiE + X2F. 

Proof (i) and (h): Combine Theorems KT2[ KUi KU\ (in): Apply Corollary ESl^ih) with Ai = dfi 
fori = 1,2. ■ 

Applying Theorem 14. 141 to A2/i,Ai/2 gives 
Corollary 4.17 

Fix(AiProxA2/i +A2ProxAi/2) = {A1X + A22/ | x = Prox/^ y, y = Prox/2(x)}. 

4.4 The case when argmin /i fl argmin /2 7^ 
Note that 

(54) Fix(Proxjj/A2) = Fix(Proxj^) = argmin /i, Fix(Proxj2/Ai) = Fix(Proxj2) = argmin /2. 
Theorem 4.18 Assume that argmin /i n argmin /2 7^ 0. Then 

(55) Fix(Ai Prox/j +A2 Prox/^) = Fix(Proxjj/A2) ^ Fix(Proxj2/Ai) = Fix(Prox/J n Fix(Prox/2). 
Moreover, 

(56) Fix(Ai Prox/^ +A2 Prox/^) = Fix(Proxj^/A2 Proxj^/^J = Fix(Proxj2/Ai Proxj^/^j). 
Proof. Apply Theorem 13. 101 ■ 
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4.5 Examples on projections 



Projection algorithms, which are instances of the proximal point algorithm, are important in ap 
plications. Let Ci,C2 Ti be nonempty closed convex sets. With /j = La, (p^ . ([37|) . ([38|) . ([39] 
transpire to 

(II — 
'-Ci (a;) + i^C2 (y) H ^ — 

(58) min 5^1 (x) = tCi(j;) + ^dc-jlx). 



(59) min g2{y) = ^dc, (y) + ic^iy), 

y 

(60) mm = An — ^ h A, — I — . 

2 A1A2 

The Fenchel-Rockafellar dual of (j57p given by (|40p transpires to 



-inf (^crc2-Ci(0) + 

with the unique solution (p, where ac2~Ci{4') = sup {(0,1/ — x) | x G Ci,y G C2}. In fact, convex 
calculus (see, e.g., O Theorem 2.1]) or Remark 14.61 vields 

(61) 4' = -Pc^{0)- 

Theorem 4.19 Let Ci,C2 ^H. he nonempty closed convex sets. Then 

(i) (Fixed points of alternating projections) S = argminr^ = |(x,y) | x = Pci{y),y = Pc2^}- 

(ii) (Fixed points of projection composition) E = argmmgi = | x = P^'^Pc'jx}. 

(iii) (Fixed points of projection composition) F = argmin5f2 = {y \ y = ^C2-fCi?/}- 

(iv) (Fixed points of the average of projections) argmin g-^ = \ z = XiPci i^) + ^^2^02 i^) } • 

Moreover, 

(i) The mapping T : 5 — )• Fix(AiPc'i + ^2Pc2) given by 

T{x,y) = Xix + X2y, 

is a homeomorphism with inverse T~^{z) = [Pcj{z), Pc2{z)) for every z G Fix(AiPc'^ + 
A2-Pc2)- -f^ence Fix(AiPci + -^2-Pc2) = ^{S) where L : Ti x n ^ Ti : {x,y) ^ Aix + A2y. 
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(ii) The mapping Hi : E ^ Fix(AiPc'i + '^2-Pc2) 5^?^en by 

Hi{x) = \ix + A2-PC2^ = X - X2(j), 

is a homeomorphism with inverse H^^{z) = Pci{z) for every z G Fix(AiPc';^ +-^2-Pc2)- Hence 
Fix{\iPc, + X2PC2) = E - X2^. 

(iii) The mapping H2 : F — t- Fix(AiPc'i + ^2Pc2) given by 

H2{y) = AiPci {y) + = ^i(t> + y, 

is a homeomorphism with inverse H2^{z) = Pciiz) for every z G Fix(AiPc';^ +'^2-^02)- Hence 
Fi^iXiPc, + X2PC2) = F + Xi^. 

(iv) Fix(AiPci + A2PC2) = Ai^ + X2F. 

Theorem 4.20 Assume that Ci, C2 ^ ^ are two closed convex sets such that Ci n C2 7^ 0. Then 
Fix(AiPci + A2PC2) = FixPc.Pc, = FixPcPc, = Ci n C2. 

Proof. As min = min g2 = min gi = ming = when Ci Pi C2 7^ 0, we have 

argmin (71 = argmin 52 = argmin (^3 = Ci Pi C2, 

and argmin (7 = {(x,x) | x G Ci H C2}. Alternatively, use Theorem 14. 181 or Theorem 13.101 ■ 

As die = -^C) Proxtp = Pc", Theorems 14.91 and l4.10l give characterizations of S, E, F, Fix(AiPc'i + 
A2-PC2) ™ terms of the dual solution cp: 

Theorem 4.21 (i) (x, y) £ S if and only if 

-^eNc,{x), ^eNc^iy), 4) = x-y. 

(ii) X £ E if and only if 

-^eNcAx), 4> = x-Pc2{x). 

(iii) y £ F if and only if 

-4> = y- PcM^ 4>^NcM- 

(iv) z G Fix(AiPc'i + A2PC2) ^/ ^'^^ '^''^^y ^/ 

-0 = A2 - ^ci(^)), = Ar'(^ - Pc2(^))- 
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5 Algorithms and examples 



In this section, notation is as in section [331 and we also assume that Fix Jyi ^ 0. By Coroharv 13.91 
E,F,S all are nonempty. The following results give different algorithms to find a point in Fix J^i. 

Theorem 5.1 (Fixed point of resolvent average by alternating resolvent method) 

Fix xq £ Ti and for every n € N, set 

Vn = JAi/XiXn, Xn+l = JA^/MVn- 

Then Aix„ + \2yn Aix + \2y G Fix Ja- 

Proof. By [71 Theorem 3.3], {xn,yn) {x,y) G "S*. By Theorem 13.61 Aia; + G Fix J^. Therefore 
XiXn + X2yn Xix + X2y G Fix Ja- ■ 

Theorem 5.2 (Fixed point of resolvent average by proximal point method) 

Fix Xo G H and for every n G N, set 

(62) Xn+l = (Ai Jai + X2JA2){Xn)- 

Then x„ ^ x G Fix Ja ■ 

Proof. As XiJai + X2JA2 = J A, the iteration (I62p is the proximal point algorithm. By Fact 12. 5^ 
Xn ^ X £ Fix Ja. B 

Theorem 5.3 (Fixed point of resolvent average by resolvent compositions) 

(i) Fix xq £ Ti and for every n G N, set 

Xn+l = J Axl\2'^ A'ljXx^n- 

Then x„ ^ x G Fix J^./Aa-^Aa/Ai o.'^'d Aix„ ^X2JA2l\x^n X^x + X2J A^jXx^ ^ Fix Ja- 

(ii) Fix yo £ Ti and for every n G N, set 

Vn+l = J A^jXx'^ AxIX^Vn- 

Then y„ ^ y G Fix Jaj/Aj Jai/Aj '^'^id X^Ja^ImVu + X2yn ^ XiJa^/x^V + >^2y G Fix Ja- 

Proof, (i). Since Jai/\2^ A2l\\ firmly nonexpansive, Fact l2.3l shows that J AyI\2'^ A2l\\ is strongly 
nonexpansive and that x„ ^ x G Fix Jai/A2'^A2/Ai • By [71 Theorem 3.3(iii)], JA2l\\^n — ^ u*, 
which implies that JA2/\\^n ^ u* + x. Hence Aix„ + X2JA2/\i^n Xix + X2{u* + x) = x + X2U* = 
Aix + A2Ja2/Ai^ G Fix Ja by Theorem 13. ^(i)[ (ii). The proof is similar to the proof of (i). ■ 
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Remark 5.4 (i). Note that when % = M"^, the weak convergence and norm convergence coincide. 
Hence in R^, the convergence in Theorems 15 . H [5^21 15 . 31 is norm convergence. 

(ii). As J A (even a projection mapping) need not be weakly sequentially continuous, one cannot 
conclude directly that \iXn+\2JA2/\i^n ^ix+\2Ja2/\i^ Theorem l5.3r i) or that \iJAx/\2Vn + 
^2yn '^i<^Ai/A2?/ + '^ay in Theorem 15. 3r ii). Indeed, following Zarantonello [271 page 245], consider 
the Hilbert sequence space i"^. Let IB := {x S £^ | ||x|| < l} and {en)neN be the basis vectors, i.e., 
en = ( 0, •••^,0,1 , 0, • • • ). We have 

n terms 

ei + Cn^ei, PB(ei) = ei, 
(Vn > 2) flB(ei + en) = 

Hence is not weakly sequentially continuous. However, in the proof of Theorem 15.31 we invoked 
the analysis in [3 Section 3.2] which allowed us to obtain the weak convergence conclusion. 

We end with three examples to illustrate our main results. 
Example 5.5 Consider 

Ci = {{x,y) \x^ + {y- 2)2 < l}, C2 = {(x,0) | x G M}. 
Then Ci Pi C2 = 0. We claim that when Ai + A2 = 1 with Aj > 0, 

Fix(AiPci+A2Pc2) = {(0,Ai)}. 
In this example. Fix Pc^Pc2 is easier to compute than Fix(AiPc'^ + '^2Pc2)- Indeed, we have 

X y — 2 \ 



Pci {x, y) = < 



if (x,y) 0C; 



'1 



VVx2 + (y-2)2 + (y _ 2)2 j 

{x,y), if(x,y)GCi 



Pc2ix,y) = ix,0). 

Thus, 



Pc,Pc2{x,y) = Pc^{x,0) 

X -2 



Vx^ + 4 ' + 4 



+ 2 



since (x,0) ^ Ci. Start with (a;o,yo)- Consider the composition algorithm (x„+i,y„+i) 
Pci Pc2 {xn,yn)- We have 
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It follows that 

I I \Xn\ ^ |^n| ^ ^ l-^ol 

|Xn+i| = , ^ < -—- < ■ ■ ■ < 



and this gives Xn+i — )• 0, consequently yn+i 1- Therefore, 

(0,1) GFixPci^Ca- 

In fact, by using 

= ( r^^ '^^=^ + ^ 
we see that {x,y) = (0, 1). Hence FixPcjPc2 = {(0, !)}• Therefore, by Theorem I4.19( ii) 

(63) Fix(AiPci + A2PC2) = Ai(0,l) + A2Pc2(0,l) = (0,Ai), 

since ^02(0, 1) = (0,0). 

For Ppj-Pcu since Pc2Pci{^i,yi) £ C2 (not in Ci) we have 



(x„+i, y„+i) = Pca-Pci (a^n, Vn) = ( , ^ , j V n > 2, 

and Fix(Pc2Pci) = {(0,0)}. Then for (0,0) G Fix(Pc2i^Ci), 

(64) AiPci(0,0) + A2(0,0) = Ai(0,l) = (0,Ai), 

which shows also that Fix(AiPc'i + A2-PC2) = -^1)}. 

On the other hand, the averaged projection method proceeds as follows. 



(AiPci + A2Pc2)(a:,y) 



Ai (—=J===, y ^ + 2 ) + A2(x, 0), if (x, y) Ci; 



^Ai(x,y) + A2(x,0), if(x,y)GCi, 
(65) (x„+i, y„+i) = (AiPci + A2-Pc2)(a:^ 

Start with any (xo,yo) £ I^^- 

Claim: If n is sufRciently large, then y„ < 2 and (x„, y„) Ci. 

To see that, for yn>'^ consider two cases: if {xn,yn) £ Ci, then y„ > 1, and 

ixn+i,yn+i) = Ai(x„,y„) + A2(x„,,0) = (x„,, Aiy„), 



which gives y„+i = Aiy„; if (a;„,y„) Ci, then \/a;2 + (y„ - 2)2 > 1 and 

(x„+i,y„+i) = Ai / 2 / 2^1 r =^+^1 +^2(xn,0), 

V V^n + KVn - 2)2 + (y„ - 2)2 J 
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so that 

yn+i = \i I , /" "^ ^ + A ^ Ai(y„-2 + 2) = Aiy„. 

V\/4 + (yn-2)2 y 

Furthermore, whenever {xn,yn) G C*!, we have yn+i = MUn and ?/„ > 1. Altogether, Un+i < 
This impHes that the averaged projection iterations can only stay in Ci for only a finite number 
of times and that for n sufficiently large Un < "2:- Hence for all n sufficiently large, the average 
projection algorithm ([65]) gives yn < 2 and 



V v^n + (yn-2)2 \^xi + {yn-2y 

Moreover, as for n sufficiently large 

1 < + 2 < 2, 

- V4 + (yn-2)2 - 

we have Ai < yn+i < Ai2 < 2. Then {x,y) £ Fix(AiPc'i + A2^'c2) means 

(x,y) = i Ai , ^ + A2X,Ai(^ + 2 

which gives only one solution {x, y) = (0, Ai) in view of Ai > 0, Ai < y < 2. Again this shows that 

Fix(AiPci+A2Pc2) = {(0,Ai)}, 

which is consistent with the results given by (|63p and (|64p . (See also [H Example 5.3] for more on 
the rate of convergence of alternating projections.) 

Now what can one say about the relationships among Fix(Ai Proxj^ +A2 Proxj^), Fix(Proxjj Proxjj), 
Fix(Proxj2 Proxj^) ? It is tempting to conjecture that for fixed points of alternating iterations: 

X = Proxjj y, y = Prox^-j x, 

one has Xix + A2?/ G Fix(Ai Prox^^ +A2 Proxj^) — and this is true for projections — but this is not 
right in general, as the following examples show. 

Example 5.6 Consider fi{x) = x^, /2(x) = (x — 1)^ for x G R. Let Ai + A2 = 1 with Aj > 0. Then 
argmin/i = {0},argmin/2 = {1}, so argmin/i nargmin/2 = 0. As V/i(x) = 2x,V/i(x)/A2 = 
2x/A2, V/2(x) = 2(x - 1), V/2(x)/Ai = 2(x - 1)/Ai, for every z G M, 

z z + 2 

Prox/,(2:) = -, Prox/2(z) = — 

r> t \ A2Z , . Aiz + 2 
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Moreover, 



We have 



.^Prox,/..Pro.,,.,.)^^^, 
y ^ Prox^,/,, Prox^,/,, (y) = ^ + 2) , 

z ^ (Ai Prox/j +A2Prox/2)(z) = | + 



Fix(Ai Proxj^ +A2 ProxjJ = {A2}, 
Fix(Proxy^/;,2 Proxj2/Ai) = {A2/3}, 
Fix(Prox^,/A, Prox^./Aj = {(2 + A2)/3}, 
S = {ix,y)\ X = Prox;,/A,(y),y = Prox^^/^, (x)} = {(A2/3, (A2 + 2)/3)}. 



As in Theorem ma ioi x £ E = {A2/3}, 

A1A2/3 + 2 

Aix + A2Proxj2/Ai(2;) = A1A2/3 + A2 — r— — r = A2 G Fix(AiProx/^ +A2Prox/2). 

As in Theorem [433 for y G F = {(A2 + 2)/3}, 

A2 2 -|- A2 2 -|- A2 
Ai Prox/-^/A2(y) + A2y = Ai ^ _^ — ^ h A2 — ^ — = A2 G Fix(Ai Prox/^ +A2 Prox/J. 

As in Theorem 14.141 ^ ^ Fix(Ai Proxj^ +A2 Proxjj) = {A2}, 

T-\\2) = (Prox/,(A2),Prox/,(A2)) = (A2/3, (A2 + 2)/3) G 5. 
As in Theorem 14. 9|. the dual solution satisfies 

-,^ = y- 3; = 2/3 = Proxj2/A,(x) -x = y- Fmxf^/x^{y), 

for (x, y) G S. 

We now show that for fixed points of alternating iterations 

X = Proxj^ y, y = Proxjj x, 
one has Aix + A2?/ ^ Fix(Ai Proxj^ +A2 Proxjj)- Indeed, as 

, , X + 2 
X I—)- Proxj^ Proxj2(x) : 

Fix(Prox/^ Prox/2) = {1/4}. With x = 1/4, we have 
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Aix + A2Prox/2(x) = All/4 + A2^^^^ = 1/4 + A2/2 / A2 G Fix(Ai Prox/, +A2 Prox/J, 
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unless A2 = 1/2. Similarly, one can also show that 

y I—)- Proxj2 Proxjj(?/) 
has Fix(Prox/2 Prox/J = {3/4}. With y = 3/4, 



y + Q 

9 ' 



Ai Prox/^(y) + \2y = 1/4 + A2/2 / A2 G Fix(Ai Prox/^ +A2 Prox/^ 
unless A2 = 1/2. 

However, for A2/i(x) = A2X^, Ai/2(x) = Ai(x — 1)^ with 



ProxA2/i(3;) 



X X + 2A1 

, ProxAi/2(x) 



2A2 + I 



for every x G M, we have 



(Ai ProxAj/i +A2 ProxAi/2)(x) = Ai— — — + A2 



2Ai + 1 ' 
X + 2A1 



By solving 



rc = Ai 



+ A 



2A2 + I 2A1 + I 
X + 2Ai 



2A2 + I 2A1 + I 



one indeed has 

Fix(Ai ProxAa/i +A2ProxAi/2) = {1/4 + A2/2} = {Aix + \2y \ x = Prox/^ y,y = Prox/2(x)}, 
as Theorem 14. 141 or Corollarv 14.171 shows. 

Example 5.7 Consider fi{x) = \x\, f2{x) = {x — 1)^ for every x G M and Ai + A2 = 1 with Aj > 0. 
Then argmin /i = {0}, argmin /2 = {1}, so argmin fi argmin f2 = 0- As 



dfi{x) = < 



1 if X > 0, 

[-1,1] ifx = 0, 
^-1 ifx<0. 



we have 



Proxj^(x) = < 



X — 1 if X > 1, 
if-l<x<l, 
^x + 1 ifx<— 1, 
X + 2 



Proxj2 (x) 



Then 



rAi(x-l) + M£M 



(AiProx/^ +A2Prox/2)(x) = < 



A2(a'+2) 
3 



[Ai(x + 1) + 



X2{x+2) 



if X > 1, 

if -1 < X < 1, 

if X < -1, 
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and 



Fix(Ai Proxj^ +A2 Proxy^) = 




Moreover, 



Proxjj Proxj2(a^) = Proxj^((rc + 2)/3) 




if x > 1 



= < 







if -5 < X < 1 



x+5 
V 3 



if x < —5 



and 



Fix(Prox/^ Prox/J = {0}. 
For X £ E = Fix(Proxjj Proxjj), i.e., x = 0, 

Xix + A2 Proxj2 (x) = AiO + A2 Proxj2 (0) 
2A 

= Fix(Ai Prox/^ +A2 Prox/^). 
Therefore, one cannot use the fixed point set of 

X = Proxjj y, y = Proxjj x, 
to recover Fix(Ai Proxj^ +A2 Proxjj). 

Now let us consider Proxj^/;)^^, Prox^^/Ai- As 




5/2(x)/Ai 



2{x - 1) 
Ai 



we have 



'x- I/A2 



if X > I/A2, 

if -I/A2 < X < I/A2, 

if X < -I/A2, 

Aix + 2 
2 + Ai ■ 



Pi'ox/i/AaCa;) = S 



,X + 1/A2 



It follows that 



Prox^^/A2 Proxj2/Ai(2^) = Proxj^/^^ ((Aix + 2)/(2 + Ai)) 
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and that 

Fix(Proxjj/A2 Proxj2/Aj = {0}. 
For X £ E = Fix(Proxjj/;^2 P^°^/2/Ai)) i-^-, x = 0, we have 

AiO + 2 2X2 



AiO + A2Prox^,/Ai(0) = A2 



G Fix(Ai Prox/-^ +A2 Proxjj 



2 + Ai 2 + Ai 
Again, these testify that 

Fix(Ai Proxj^ +A2 ProxjJ = {Aix + A2 Proxjj/Ai (a^)l x G i?}. 

Similarly, one can verify that 

'^i^^^ift^ ifx>l/A2, 
Proxj2/Ai Proxj^/;,2(^) = "! 2^ if -I/A2 <x< I/A2, 

if X < — I/A2, 



2+Ai 

Ai(x+l/A2)+2 
^ 2+Ai 



and 



F = Fix(Prox^,/,^ Prox^./Aj = {j^] ■ 
For yeF, i.e., < y = 2/(2 + Ai) < 1, 



AiProxj^/A2(y) + A2y = A1O + A2- 



2A2 



G Fix(Ai Proxj^ +A2 Froxj^ 



Again, 

Finally, since 



'(2 + Ai) 2 + Ai 
Fix(Ai Proxj^ +A2ProxjJ = {Ai Proxj^/;,^ (y) + Agyj | y G F}. 



5 = {(x,Prox;,/A,(x))| X G i?} = I (^0, I , 



we have (p = -2/(2 + Ai) 



More examples can be constructed by using the proximal mapping calculus developed by Combettes 
and Wajs [IB] . 

Remark 5.8 We conclude by pointing out that the situation for three or more functions (or sets 
if we work with indicator functions) is not clear at the moment. For instance, as pointed out by 
De Pierro and attributed to lusem |17] . one may have 3 sets such that least squares solutions exist 
but the existence of fixed points of compositions depends on the order of the projections. To fully 
understand these situations is an interesting topic for further research. 
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